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Abstract. The paper concerns the second-order generahzed differentiation theory of variational 
analysis and new applications of this theory to some problems of constrained optimization in finite- 
dimensional spaces. The main attention is paid to the so-called (full and partial) second-order subdiffer- 
entials of extended-real-valued functions, which are dual-type constructions generated by coderivatives 
of first-order subdifferential mappings. We develop an extended second-order subdifferential calculus and 
analyze the basic second-order qualification condition ensuring the fulfillment of the principal second- 
order chain rule for strongly and fully amenable compositions. The calculus results obtained in this way 
and computing the second-order subdifferentials for piecewise linear-quadratic functions and their major 
specifications are applied then to the study of tilt stability of local minimizers for important classes of 
problems in constrained optimization that include, in particular, problems of nonlinear programming and 
certain classes of extended nonlinear programs described in composite terms. 
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1 Introduction 

Variational analysis has been recognized as a fruitful area of mathematics, which primarily deals 
with optimization-related problems while also applying variational principles and techniques 
(largely based on perturbation and approximation ideas) to a broad spectrum of problems that 
may not be of a variational nature. We refer the reader to the books by Borwein and Zhu [3], 
Mordukhovich [29, 30], Rockafellar and Wets [45], and the bibliographies therein for the major 
results of variational analysis and its numerous applications. 

Since nonsmooth functions, sets with nonsmooth boundaries, and set-valued mappings nat- 
urally and frequently appear in the framework of variational theory and its applications via 
using variational principles and techniques (even for problems with smooth initial data), tools 
of generalized differentiation play a crucial role in many aspects of variational analysis and 
optimization; see, e.g., the books [3, 7, 10, 17, 29, 30, 45, 46] and their references. 

Over the years, the first-order subdifferential theory of variational analysis has been well 
developed and understood in both finite-dimensional and infinite-dimensional settings; see [3, 
29, 45] and the commentaries therein. In contrast, the second-order theory still requires a lot of 
further development and implementation, although many second-order generalized differential 
constructions have been suggested and successfully applied to various optimization, sensitivity, 
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and related problems; see, e.g., the books [2, 29, 45] summarizing mainstream developments and 
trends in the second-order theory and its applications. 

As is well known, there are two generally independent approaches to second-order differen- 
tiation in the classical analysis. One of them is based on the Taylor expansion while the other 
defines the second derivative of a function as the derivative of its first-order derivative. 

In this paper we develop the latter "derivative-of-derivative" approach to the second-order 
generalized differentiation of extended-real-valued functions (^iR" ^ M := (—00,00] finite at 
the reference points. The dual-space route in this vein suggested by Mordukhovich [24] is to 
treat a (first-order) subdifferential dip of c/? as a set-valued analog of the classical derivative for 
nonsmooth functions and then to define a second- order subdifferential d^(p oi (p via a coderivative 
(generalized adjoint derivative operator) D*d(p of the subgradient mapping d(p\ see Section 2 for 
more details. This second-order construction was originally motivated by applications to sen- 
sitivity analysis of variational systems [24, 27] inspired by the coderivative characterization of 
Lipschitzian stability [24, 25], but then the second-order subdifferential and its modification were 
successfully employed in the study of a broad spectrum of other important issues in variational 
analysis and its applications; see, e.g., [4, 9, 11, 12, 13, 15, 17, 18, 19, 29, 30, 31, 32, 36, 39, 50, 51] 
and the references therein. We specifically mention a remarkable result by Poliquin and Rockafel- 
lar [39] who established a full characterization of tilt-stable local minimizers of functions (a new 
notion introduced by them motivated, in particular, by the justification of numerical algorithms) 
as the positive-definiteness of the second-order subdifferential mapping. For functions, the 
latter criterion reduces to the positive-definiteness of the classical Hessian matrix — a well-known 
sufficient condition for the standard optimality in unconstrained problems, which happens to 
be necessary and sufficient for tilt-stable local minimizers [39]. We also refer the reader to the 
recent papers by Chieu et al. [4, 5] providing complete characterizations of convexity and strong 
convexity of nonsmooth (in the second order) functions via positive-semidefiniteness and defi- 
niteness of their second-order subdifferentials d'^tp. Related characterizations of monotonicity 
and submonotonicity of continuous mappings can be found in [6] . 

Needless to say that efficient implementations and potential extensions of the latter result 
to constrained optimization problems, as well as any other valuable applications of the afore- 
mentioned second-order subdifferential construction and its modifications, largely depend on the 
possibility to develop a fairly rich second-order subdifferential calculus and on precisely calculat- 
ing such constructions for attractive classes of nonsmooth functions overwhelmingly encountered 
in variational analysis and optimization. A certain amount of useful second-order calculus rules 
were developed in [18, 26, 28, 29, 31, 32, 34]. On the other hand, precisely calculating the 
second-order subdifferential entirely in terms of the initial data was effected for the following 
major classes of extended-real-valued functions particularly important in various applications: 

• For the indicator functions of convex polyhedra and related settings it was initiated by 
Dontcliev and Rockafellar [9] and then developed in [1, 12, 13, 15, 16, 35, 40, 48] for more 
involved frameworks. The obtained calculations played a crucial role in deriving [9] verifiable 
characterizations of Robinson's strong regularity [41] for variational inequalities over (convex) 
polyhedral sets as well as their specifications for complementarity problems and the associated 
Karush-Kuhn- Tucker (KKT) conditions for nonlinear programs with data. Further results in 
this vein on Lipschitzian stability of parametric variational systems were given in [1, 12, 35, 40, 
49] and other publications in both finite and infinite dimensions. Applications to stationarity 
conditions for stochastic equilibrium problems with equilibrium constraints in electricity spot 
market modeling were developed by Henrion and Romisch [15]. 

• For the so-called separable piecewise functions it was done by Mordukhovich and Outrata 
[31]; see also [4] for further developments, it provided the basis for the efficient sensitivity analysis 
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[31] of mathematical programs with equihbrium constraints (MPECs) including practical ones 
that arose in applications to certain contact problems of continuum mechanics. 

• For indicator functions to smooth nonpolyhedral inequality systems it was done by Henrion, 
Outrata, and Surowicc [13] by employing and developing the transformation formulas from [31]. 
Then these calculations were applied in [14, 47] to deriving stationarity conditions for equilibrium 
problems with equilibrium constraints (EPECs) in both deterministic and stochastic frameworks 
and to EPEC models of oligopolistic competition in electricity spot markets. 

• For the special class of functions arising in optimal control of the Moreau sweeping process 
is was done in the paper by Colombo et al. [8]. These calculations played a significant role in 
deriving constructive optimality conditions for discontinuous differential inclusions generated by 
the sweeping process with great potentials for further applications. 

Now we briefly describe the main goals and achievements of this paper. Our primary atten- 
tion is focused on the following major issues new in second-order variational analysis: 

• Developing refined second-order chain rules of the equality and inclusion (outer/upper 
estimate) types for the aforementioned second-order subdifferential and its partial modifications. 

• Analyzing the basic second- order qualification condition ensuring the fulfillment of the 
extended second-order chain rules for strongly amenable compositions. 

• Precise calculating second-order subgradients for major classes of fully amenable functions. 

• Applications of the obtained calculus and computational results to deriving necessary op- 
timality conditions as well as to establishing complete characterizations of tilt-stable minimizers 
for broad classes of constrained optimization problems including those in nonlinear programming 
(NLP) and extended nonlinear programming (ENLP) described via amenable compositions. 

The rest of the paper is organized as follows. Section 2 contains basic definitions and brief 
discussions of the first-order and second-order generalized differential constructions studied and 
used in the paper. We also review there some preliminary results widely employed in the sequel. 

In Section 3 we deal with second-order chain rules of the equality and inclusion types for 
the basic second-order subdifferential and its partial counterparts. The equality-type results 
are established under the full rank condition on the Jacobian matrix of the inner mapping of 
the composition. Without imposing the latter assumption, we develop a new quadratic penalty 
approach that allows us to derive inclusion-type second-order chain rules for a broad class of 
strongly amenable compositions valid under certain second-order qualification conditions. The 
latter chain rules generally provides merely outer estimates of the second-order subgradient sets 
for compositions: we present an example showing that the chain rule inclusion may be strict even 
the linear inner mapping and piecewise linear outer functions in fully amenable compositions. 

Section 4 is devoted to a detailed analysis of the basic second- order qualification condition 
ensuring the underlying second-order chain rule for strongly amenable compositions. Although 
the latter condition is automatically fulfilled under the full rank assumption on the Jacobians of 
inner mappings as well as for C^'^ outer functions in compositions, it seems to be rather restrictive 
when outer functions arc cxtcndcd-rcal-valucd. In particular, we show that the second-order 
qualification condition reduces locally to the full rank requirement on the inner mapping Jacobian 
matrix if the outer function is either convex piecewise linear, or it belongs to a certain major 
class of piecewise linear-quadratic functions. The results obtained in this direction are based 
on precise calculations of the second-order subgradient sets of the remarkable classes of fully 
amenable compositions under consideration. 

The concluding Section 5 concerns applications of the chain rules and calculation results 
developed in the previous sections to the study of tilt-stable minimizers for some classes of 
constrained optimization problems represented in composite formats, which are convenient for 
developing both theoretical and computational aspects of optimization. Such classes include, 
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besides standard nonlinear programs (NLP), broader models of the so-called extended nonlinear 
programming (ENLP). Based on the second-order sum and chain rules with equalities, we derive 
complete characterizations of tilt-stable local minimizers for important problems of constrained 
optimization. The results obtained show, in particular, that for a general class of NLP problems 
the well-recognized strong second- order optimality condition is necessary and sufficient for the 
tilt-stability of local minimizers, which therefore is equivalent to Robinson's strong regularity of 
the associated variational inequalities in such settings. Furthermore, the calcuhis rules obtained 
in this paper for partial second-order subdiffcrcntials lead us also to characterizations of full 
stability in optimization (see Remark 5.6), while a detailed elaboration of this approach is a 
subject of our ongoing research. 

Although a number of the results obtained in this paper hold in (or can be naturally extended 
to) infinite-dimensional spaces, we confine ourselves for definiteness to the finite-dimensional 
setting. Throughout the paper we use standard notation of variational analysis; cf. [29, 45]. 
Recall that, given a set-valued mapping F: M" ^ W^, the symbol 



LimsupF(a;) '■= \y 

(1.1) 



3 Xfe — >■ x, 3 yfe — )■ 2/ as k oo 
with yk G F{xk) for all k e IN := {1, 2, . . .}| 

signifies the Painleve-Kuratowski outer/upper limit of F as x x. Given a set C M" and an 

extended-real- valued function ip:W^ -> M finite at x, the symbols x x and x ^ x stand for 
X X with x E CI and for x x with ip{x) ^{x), respectively. 



2 Basic Definitions and Preliminaries 

In this section we define and briefly discuss the basic generalized differential constructions of our 
study and review some preliminaries widely used in what follows; see [29, 45] for more details. 

Let M" — )■ M be an extended-real-valued function finite at x. The regular subdifferential 
(known also as the presubdifferential and as the Prechet or viscosity subdifferential) of (p at x is 

(p{x)-(p{x) - {v,x-x) ^ ^ 
\\x — x\\ ~ J 

Each V G d(p{x) is a regular subgradient of (p at x. While d(p{x) reduces to a singleton {V(p{x)} 
if if is Prechet differentiable at x with the gradient Vip{x) and to the classical subdifferential of 
convex analysis if (p is convex, the set (2.1) may often be empty for nonconvex and nonsmooth 
functions as, e.g., for (p{x) = — |x| at x = G M. Another serious disadvantage of the subd- 
ifferential construction (2.1) is the failure of standard calculus rules inevitably required in the 
theory and applications of variational analysis and optimization. In particular, the inclusion 
(outer estimate) sum rule d{ipi + (p2){x) C dipi{x) + d(p2{x) does not hold for the simplest 
nonsmooth functions V'i(x) = |x| and 932(2^) = ^|-^| at .x = G M. 

The picture dramatically changes when we employ a limiting "robust regularization" proce- 
dure over the subgradient mapping dip{-) that leads us to the (basic first-order) subdifferential 
of (/p at X defined by 

(2.2) (?(^(x) := Limsup(9(^(x) 

V - 

x-^x 

and known also as the general, or limiting, or Mordukhovich subdifferential; it was first intro- 
duced in [22] in an equivalent way. Each v G dip{x) is called a (basic) subgradient of ip at x. 



(2.1) 



dip{x) := I 



V G 



4 



Thus, by taking into account definition (1.1) of Limsup and the notation x ^ re, we represent 
the basic subgradients v £ dip{x) diS follows: 

there are sequences x with (p{xk) — ^ ^{x) and & dip{xk) with Vk — > v. 

In contrast to (2.1), the subgradient set (2.2) is generally nonconvex (e.g., dip{^) = {—1,1} 
for ip{x) = —\x\) while enjoying comprehensive calculus rules ("full calculus"); this is based on 
variational/ extremal principles, which replace separation arguments in the absence of convexity. 
Moreover, the basic subdifferential (2.2) occurs to be the smallest among any axiomatically 
defined subgradient sets satisfying certain natural requirements; see [33, Theorem 9.7]. 

In what follows wc also need another subdifferential construction effective for non-Lipschitzian 
extended-real-valued functions. Given M" -> R finite at x, the singular /horizontal subdiffer- 
ential d°°<p{x) of at X is defined by 

(2.3) d°°(p{x) := Limsup Xd(p{x). 

v', - 

\\.Q 

If the function (p is lower semicontinuous (l.s.c.) around x, then d°°(p{x) = {0} if and only if ip 
is locally Lipschitzian around this point. 

Given further a nonempty subset Q C M", consider its indicator function S(x;Q,) equal to 
for X G and to oo otherwise. For any fixed x E fl, define the regular normal cone to at x by 

(2.4) iV(x; n) := d5{x; n) = \v e lim sup ^ < o| 

^ n _ \\x X J 

x^x 

and similarly the (basic, limiting) normal cone to $7 at x by N{x\ il) := db{x\ il). It follows from 
(2.2) and (2.4) that the normal cone iV(.T; $7) admits the limiting representation 

(2.5) Ar(x; 9) = Lim sup iV(x; O) 

n _ 
x^x 

meaning that the basic normals v G iV(x; $7) arc those vectors v € M" for which there are 
sequences Xfc — > x and Vk ^ v with Xfc G Q and Vk G N{xk]0,), k G JN. If Q, is locally closed 
around x, (2.5) is equivalent to the original definition by Mordukhovich [22]: 

N{x; Q) = Lim sup cone(x — n(x; Q)) 

x^x 

where n(x; fi) signifies the Euclidean projector of x G M" on the set fi, and where "cone" stands 
for the conic hull of a set. 

There is the duality/polarity correspondence 

(2.6) iV(x;f]) = r(x;f])* :=|?;GM" {v,w)<0 for ah w;GT(x;0)} 
between the regular normal cone (2.4) and the tangent cone to O at x G O defined by 

(2.7) T{x;Q) := G M" 3xfc G O, Bctfe > with afc(xfc - x) ^ w as k ^ cx)| 

and known also as the Bouligand-Severi contingent cone to Q at this point. Note that the basic 
normal cone (2.5) cannot be tangentially generated in a polar form (2.6) by using some set of 
tangents, since it is intrinsically nonconvex while the polar T* to any set T is automatically 
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convex. In what follows we may also use the subindex set notation like Na{x), Tq(x), etc. for 
the constructions involved. 

It is worth observing that the convex closure 

(2.8) N{x;n) --clcoNixin) 

of (2.5), known as the Clarke/convexified normal cone to at x (see [7]), may dramatically 
enlarge the set of basic normals (2.5). Indeed, it is proved by Rockafellar [43] that for every 
vector function /: — t- locally Lipschitzian around x the convexified normal cone (2.8) to 
the graph of / at (x, f{x)) is in fact a linear subspace of dimension d > m in x M™, where 
the equality d = m holds if and only if the function / is strictly differentiable at x with the 
derivative (Jacobian matrix) denoted for simplicity by V/(S), i.e., 

f{x)-f{u)-Vf{x){x-u) _^ 

x,u-^x \\x — u\\ 

which is automatic when / is around x. In particular, this implies that N{{x, f{x));gph. f) 
is the whole space x R"* whenever / is nonsmooth around x, n = 1, and m > 1. Moreover, 
the aforementioned results are discovered by Rockafellar [43] not only for graphs of locally Lips- 
chitzian functions, but also for the so-called Lipschitzian manifolds (or graphically Lipschitzian 
sets), which are locally homeomorphic to graphs of Lipschitzian vector functions. The latter 
class includes graphs of maximal monotone relations and subdifferential mappings for convex, 
saddle, lower-C^, and more general prox-regular functions typically encountered in variational 
analysis and optimization. In fact such graphical sets play a crucial role in the coderivative and 
second-order subdifferential constructions studied in this paper. 

Given a set- valued mapping F:R" =^ W^, define its coderivative at {x,y) G gphF by [23] 

(2.9) D*F{x,y){v) := i^^ueR^'l {u,-v) e N{{x,y);gphF)y veR'^, 

via the normal cone (2.5) to the graph gphF. Clearly the mapping D*F{x,y):W^ =^ R" is 
positive-homogeneous; it reduces to the adjoint derivative 

(2.10) D*F{x){v) = {VF{x)*v}, v G R"*, 

where * stands for the matrix transposition, if F is single- valued (then we omit y = F{x) in 
the coderivative notation) and strictly differentiable at x. Note that the coderivative values in 
(2.9) are often nonconvex sets due to the nonconvexity of the normal cone on the right-hand 
side. Furthermore, the latter cone is taken to a graphical set, and thus its convexification in 
(2.9) may create serious troubles; see above. 

The main construction studied in the paper was introduced in [24] as follows. 

Definition 2.1 (second- order subdifferential). Let the function (p-.M."' — R 6e finite at 
X, and let y G dip{x) be a basic first-order subgradient of ip at x. Then the SECOND-ORDER 
SUBDIFFERENTIAL of at X relative to y is defined by 

(2.11) aV(S, y){u) := {D*dip){x, y){u), u G R", 

via the coderivative (2.9) of the first- order subdifferential mapping (2.2). 

Observe that if (/? G around x (in fact, it is merely continuous differentiable around x with 
the strict differentiable first-order derivative at this point), then 

d'^ip{x){u) = {V'^(p{x)u}, u G R", 
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where V^(^(x) is the (symmetric) Hessian of (/? at x. Sometimes the second-order construction 

(2.11) is called the "generalized Hessian" of </? at the reference point [39]. Note also that for the 
so-called C^'^ functions (i.e., continuously differentiable ones with locally Lipschitzian derivatives 
around x; another notation is C^"*"), we have the representation 

d'^ip{x){u) = d{u, V(p){x), u e W, 

via the basic first-order subdifferential (2.2) of the derivative scalarization (n, Vtp) (x) := {u, Vip{x)) 
as X G M"; see [29, Proposition 1.120]. It is worth emphasizing that the second-order subdif- 
ferential (2.11) as well as the generating coderivative and first-order subdifferential mappings 
are dual-space intrinsically nonconvex constructions, which cannot correspond by duality to any 
derivative-like objects in primal spaces studied, e.g., in [2, 45]. 

Following the scheme of Definition 2.1 and keeping the coderivative (2.9) as the underlying 
element of our approach while using different first-order subdifferentials in (2.11), we may define 
a variety of second-order constructions of type (2.11). In particular, for functions (p:W^ x 

^ R of {x,w) G M" X there are two reasonable ways of introducing partial second- 
order subdifferentials; cf. [19]. To proceed, define the partial first-order subgradient mapping 
da;ip: M" X M'^ ^ by 

dx<p{x,w) := |set of subgradients v of '■= ^{'iw) at x| = d(pw{x). 

Then given {x,w) and y G dx<f{x,w), define the partial second-order subdifferential of (p with 
respect to x of at {x, w) relative to y by 

(2.12) dlipix,w,y)iu) := {D*d^i,){x,y){u) = aV«)(x, y)(n), u G M", 

with ipij[,{x) = f{x,w). On the other hand, we can define the extended partial second-order 
subdifferential of ip with respect to x of at (x, w) relative to y by 

(2.13) dlipix,w,y){u):={D*dxip)ix,w,y){u), uGR^. 

As argued in [19], constructions (2.12) and (2.13) arc not the same even in the case of functions 
when (2.12) reduces to Vxx'Pix,u!){u) while (2.13) comes out as (V^a,(/5(x, tD)u, V^^9?(x, tD)u). 
This happens due to the involvement of^ w in the limiting procedure to define the extended 
partial second-order subdifferential set dx^{x,w,y){u), which is hence larger than (2.12). Note 
that both partial second-order constructions (2.12) and (2.13) are proved to be useful in appli- 
cations; see, e.g., [18, 19] for more details. 

It has been well recognized and documented (see, e.g., [3, 29, 30, 45, 46] and the references 
therein) that the first-order limiting constructions (2.2), (2.5), and (2.9) enjoy full calculi, which 
are crucial for their numerous applications. Based on definitions (2.11) of the second-order sub- 
differential and its partial counterparts (2.12) and (2.13), it is natural to try to combine calculus 
results for first-order subgradients with those for coderivatives to arrive at the corresponding 
second-order calculus rules. However, there are nontrivial complications to proceed in this way 
due to the fact that general results of the first-order subdifferential calculus hold as inclusions 
while the coderivative (2.9) does not possesses any monotonicity properties. Thus the initial 
requirement arises on selecting classes of functions for which calculus rules for first-order sub- 
gradients hold as equalities. Proceeding in this direction, a number of second-order calculus rules 
have been established in [18, 26, 28, 29, 31, 32, 34] for full while not for partial second-order 
subdifferentials in finite and infinite dimensions. 

In the next section we obtain new second-order chain rules applied to full and partial second- 
order subdifferentials and develop, in particular, a direct approach based on quadratic penalties 
to derive general results for strongly amenable compositions. 
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3 Second-Order Subdifferential Chain Rules 

Given a vector function h: W^xW^ with m < n and a proper extended-real- valued function 

6: M"* — )• M, consider the composition 

(3.1) ip{x, w) = {eo h){x, w) := e{h{x, w)) 

with X G M" and w G W^. Our first theorem provides exact formulas for calculating the partial 
second-order subdifferentials (2.12) and (2.13) of composition (3.1) under the full rank condition 
on the partial derivative (Jacobian matrix) Vxh{x, jB) at the reference point. 

Theorem 3.1 (exact second-order chain rules with full rank condition). Given a point 
{x^w) G M" X W'-, suppose that 6 in (3.1) is finite at z := h{x,iv), that h{-,w):W^ is 
continuously differentiable around x with the full row rank condition 

(3.2) TainkVxh{x,w) = m, 

and that the mapping Vxh{-,w):W^ — )• R™ is strictly differentiable at x. Pick any y G dx<f{x,w) 
and denote by v a unique vector satisfying the relationships 

V & d9{z) and V xh{x,w)*v = y. 

Then we have the chain rule equality for the partial second-order subdifferential (2.12).- 

(3.3) d'^(p{x, w, y){u) = V^^(t;, /i)(x, w)u + Vxh{x, u})*d'^9{z, v){Vxh{x, w)u), u G M". 

If in addition the mapping /irM" x M*^ — )• is continuously differentiable around {x,iv) and its 
derivative V/iiM" x M*^ — > M™ is strictly differentiable at {x,w), then we have 

dlip{x,w,y){u) = (vlx{v,h){x,w)u,Vl^{v,h){x,w)uj 
(3.4) 

+ (Vxh{x, w)*d'^e{z, v)(Vxh{x, w)u),Vwh{x, w)*d'^e{z, v){Vxh{x, w)u)j 
whenever u G M" for the extended partial second-order subdifferential (2.13). 

Proof. We derive the chain rule (3.4) for the extended partial second-order subdifferential; the 
proof of (3.3) is just a simplification of the one given below. 

On the first-order subdifferential level we have from [29, Proposition 1.112] under the as- 
sumptions made (and from [45, Exercise 10.7] under some additional assumptions) that there is 
a neighborhood U of {x,w) such that 

dx(p{x,w) = ^y eW^ 3v e d9{h{x,w)) with Vxh{x,w)*v = y^ for all {x,w)eU. 

For any fixed y G dx<f{x,w), this gives us locally around {x,w,y) the graph representation 



(3.5) 



gph dx(p= {x, w, y) xW^ xW 3 {p, v) G gph 6 such that 

h{x,w)=p, V xh{x , w)* v = y'^ . 



Consider now the two possible cases in the graph representation (3.5): (i) the "square" case 
when m = n and (ii) the "general" one when m < n. 



8 



In the square case (i) we have by the full rank condition (3.2) that the matrix Vxh{x, w) is 
invertible for {x,w) near (x, w), and hence (3.5) can be rewritten as 

(3.6) gph d^ifi = I (x, w, y) G R" X R*^ X R" /(x, w, y) G gph dO^ 
via the mapping /: R" x R*^ x R" — >■ R^" given by 

(3.7) f{x,w,y):=(h{x,w),{'Vxh{x,w)*)~^y^ for {x,w,y) near {x,w,y). 

In other words, representation (3.6) can be expressed via the preimage/inverse image of the set 
gph do under the mapping / as follows: 

(3.8) gphdxip = rHgp^de)- 

Since Vxh is assumed to be strictly differentiable at {x,w), the mapping / in (3.7) is strictly 
differentiable at {x,ijd,y) and, by (3.2) with m = n, its Jacobian matrix V f{x,w,y) has full row 
rank 2n. Employing [29, Theorem 1.17] to (3.8) gives us 

(3.9) N{{x, w, y); gph 9^9?) = V/(x, w, y)*N{f{x, w, y); gph 89). 

Now we calculate the derivative/ Jacobian matrix of / at {x,w,y) by using the particular 
structure of / in (3.7), the classical chain rule, and the well-known Leach inverse function 
theorem for strictly differentiable mappings; see, e.g., [10, 29]. Define the mappings /i:R" x 
R'' X R" ^. R" and /2: R'* x R'^ x R" ^ R" with / = (/i, /s) by fi{x, w, y) := f{x, w) and 

f2{x,w,y) := (Vxh{x,w)-^)*y for (x, ■w, y) G R'' x R'^ x R". 

It is clear that V fi{x,w,y) = (V/(x, u;), 0), while for calculating V f2{x,w,y) we introduce two 
auxihary mapping g: R" x R'^ x R" ^ R" and R" x R'' x R" ^ R by 

g{x,w,p) := Vxh{x,w)*p and q{x,w,p) := {p,h{x,w)) for (x, u),p) G R" x R'' x R". 

Note that g{x,w,p) = Vqx{x,w,p)* and that g{x,w,f2{x,w,y)) — v = 0. Differentiating the 
latter equality gives us 

(3.10) Vxg{x,w,f2{x,w,y)) + Vpg{x,w,f2{x,w,y))Vxf2{x,w,y) =0. 

Observing further that Vxg{x,w,p) = Vx(VxQ{x,w,p))* = VxxQ{x,w,p), we get from (3.10) 
and the definitions above that the equation 

w) ^)*y, h{x, w)) + Vxh{x, w)*Vf2{x, w,p) = 

is satisfied, which implies in turn the representation of the partial derivative 

(3.11) Vxf2{x, w, y) = -{Vxh{x, w)'^)* ■ vL((V^/i(x, w)-^)*y, h{x, w)). 
Similarly we have the following representation of the other partial derivative of /2: 

(3.12) VMx, w, y) = -{Vxh{x, w)-^)* ■ vU{Vxh{x, w)-^yy, h{x, w)). 
Taking into account that Vyf2{x,w,y) = {Vxh{x,w))~^)* gives us finally 

Vxh{x,w) Vwh{x,w) 



(3.13) Vf{x,w,y) 



Vxh{x,w,y) Vwh{x,w,y) {'Vxh{x,w) ^)* 
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where V xf2{x,w,y) and V w f2{x , w , y) are calculated in (3.11) and (3.12), respectively. The 
second-order chain rule (3.4) in the square case (i) follows now from substituting (3.13) into (3.9) 
and by using then the definitions of the constructions involved and elementary transformations. 

It remains to consider the general case (ii) with m < n. This case can be reduced to the 
previous one by introducing a linear mapping h: M" x M'^ — > M"^™ such that the mapping 

h{x,w) := {h{x,w)Ji{x,w)) from M'" x M"' to W 

has full rank. It can be done, e.g., by choosing a basis {04, . . . , On-m} for the n — m-dimensional 
spaces {u € M"| \/hx{x, w)u = 0} and letting /i(x, w) := {h{x, w), (oi, x), . . . , (a„_m, x)); cf. [45, 
Exercise 6.7] for a first-order setting. Then viewing (p as Ooh with 6(z,p) := 9{z) for all z G 
and p G M"~"* reduces (ii) to (i) and thus completes the proof of the theorem. A 

Some remarks on the results related to those obtained in Theorem 3.1 are in order. 

Remark 3.2 (discussions on second-order chain rules with full rank/surj activity con- 
ditions). Previously known second-order chain rules of type (3.3) were derived for the full 
second-order subdifferential (2.11), where condition (3.2) was written as rankV/i(x) = m. To 
the best of our knowledge, the first result in this direction was obtained in [31, Theorem 3.4] 
with the inclusion "c" in (3.3). Various infinite-dimensional extensions of (3.3) in the inclusion 
and equality forms were derived in [28, 34] and [29, Theorem 1.127] with imposing the surjectiv- 
ity condition on the derivative V/i(x) as the counterpart of (3.2) in infinite-dimensional spaces. 
Observe that the proof of (3.4) given above in case (i) corresponding to the invertible partial 
derivative \^xh{x, id) holds in any Banach space, while the device in case (ii) is finite-dimensional. 

Next we explore the possibility of deriving second-order chain rules for (3.1) when the rank 
condition (3.2) may not be satisfied. This can be done for broad classes of amenable functions 
defined in the way originated in [37] , which are overwhelmingly encountered in finite-dimensional 
parametric optimization. Recall [20] that a proper function ip: x M'' — > M is strongly amenable 
in X at a; with compatible parametrization in w at w if there is a neighborhood V of {x,iD) on 
which (f is represented in the composition form (3.1), where h is of class while is a proper, 
l.s.c, convex function such that the first-order qualification condition 

(3.14) d'^e{h{x, w)) n ker V^/t(5, w)* = {0} 

involving the singular subdiff'erential (2.3) is satisfied. The latter qualification condition auto- 
matically holds if either 9 is locally Lipschitzian around h{x, w) or the full rank condition (3.2) 
is fulfilled, since it is equivalent to 

keTVxh{x,w)* := {v G M"| = Va:h{x,w)*v} = {0}. 

Properties of strongly amenable compositions (p{x) = 9{h{x)) and related functions are largely 
investigated in [37, 38, 45]; most of them hold also for strongly amenable compositions (3.1) 
with compatible parametrization [19, 20]. Strong amenability is a property that bridges between 
smoothness and convexity while covering at the same time a great many of the functions that 
are of interest as the essential objective in minimization problems; see [45] for more details. 

The next theorem establishes second-order subdifferential chain rules of the inclusion type 
for strongly amenable compositions with no full rank requirement (3.2). 

Theorem 3.3 (second-order chain rules for strongly amenable compositions). Let 

ip: M" X ^ M 6e strongly amenable in x at x with compatible parametrization in w at w, and 
let y G dx(p{x,w). Denote z := h{x,w) and consider the nonempty set 

M{x,w,y) := eW^ v e d9{z) with S/xh{x,w)*v = yY 



10 



Assume the fulfillment of the second-order qualifi,cation condition: 

(3.15) d'^e{z; v){0) n ker V^/i(x, w)* = {0} for all v G M{x, w, y). 

Then we have the following chain rules for the partial second-order subdifferentials (2.12) and 
(2.13), respectively, valued for all u G : 

(3.16) dlip{x,w,y){u) C (J Vl^{v,h){x,w)u-\-Vxh{x,w)*d'^e{z,v){Vxh{x,w)u), 



(3.17) 



dl(f{x,w,y){u) C IJ (\7l^{v,h){x,w)u,Vl^{v,h){x,w)u 

vEM(x,iv,y) 



+ 



(Vxh{x, w)*d'^9{z, v){Vxh{x, w)u),Vwh(x, w)*d'^6{z, v){Vxh{x, w)u)j . 



Proof. For brevity and simplicity of the arguments and notation, we present a detailed proof 
just for the full second-order subdiffercntial (2.11) of the strongly amenable nonparameterized 
compositions (p{x) = 9{h{x)) in which case both formulas (3.16) and (3.17) reduce to 

(3.18) d'^(p{x,y){u) C (J (v^{v,h){x)u-\-Vh{x)*d^e{z,v){Vh{x)u)) 

vede{z) 

^h{x)*v=y 

with z = h{x) under the basic second-order qualification condition 

(3.19) d'^e{z; v){0)n ker V h{xy = {0} whenever v e de{z) and Vh{x)*v = y. 

The reader can readily check that the method of quadratic penalties developed below perfectly 
works for the case of partial second-order subdifferentials to produce the chain rule inclusions 
(3.16) and (3.17) under the "partial" second-order qualification condition (3.15). 
We begin with observing that the first-order chain rule 

(3.20) d^ix) = Vh{x)*de{h{x)) whenever x£U 

holds as equality for strongly amenable compositions on some neighborhood U of x. Indeed, 
it follows from the more general chain rule of [29, Theorem 3.41(iii)] due to (2.10) and the 
particular properties of strongly amenable functions summarized in [45, Exercise 10.25]. 

Now we proceed with calculating of the second-order subdiffcrential d'^ip{x,y) for the given 
first-order subgradient y G d<p{x). The definitions in (2.1), (2.9), and (2.5) suggest to us cal- 
culating the regular normal cone N({x,y);il,) to the subdiffercntial graph O := gphdcp of (p at 
points {x,y) G gphdcp near {x,y) and then passing to the limit therein as {x,y) — > {x,y). To 
simplify notation, let us focus first on calculating N{{x,y);Q) for the graphical set $7. Devel- 
oping a variational approach to subdiffcrential calculus and employing the smooth variational 
description of regular normals from [45, Theorem 6.11] and [29, Theorem 1.30], we have that 
(w, —$,) G N{{x, y); 17) if and only if there is a smooth function t?: M" x M" -)■ M such that 

(3.21) argmin(^^2^)gnt?(x,y) = {(x,y)} and Vi?(x, y) = (-w, 0- 

Using the first-order chain rule formula (3.20) allows us to transform the minimization problem 
in (3.21) into the following one: 



(3.22) 



minimize 'd(^x,Vh{x)*v^ overall 

X G R", {v, z) G gph.de with h{x) -z = 0. 
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We know from (3.21) that (x, z, v) is an optimal solution to (3.22) if and only if 

(3.23) X = X, z = z, and Vh{x)*v = y. 

Let G := gph.6 and for any e > consider the quadratic penalty problem: 

^2 24^ / minimize 'd(^x,Vh{x)*v^ + — \\h{x) — z||^ 

[ over all x G M" and {z, v) G G. 

Denoting by e 5(e) the optimal solution map for problem (3.24), observe that it is of closed 
graph and uniformly hounded around e = 0. Indeed, it follows from the closedness of g-phdO 
due to the convexity and lower semicontinuity of 9, the local continuity of i? and V/i, and the 
uniform boundedness near (x, y) of the mapping M: =^ M"' given by 

(3.25) M(x, y) := jt; G de{h{x)) Vh{x)*v = y} 

with J7 = gph dip. The latter local boundedness can be easily verified arguing by contradiction 
due the qualification condition (3.14) in the definition of amenable functions. 

Now consider a sequence of values e^. ^ as A; — t' oo and pick a triple (x^, z^, Vfc) G S{ek) for 
all k G IV. By the local boundedness of the solution map S{£) near £ = the sequence {v^} is 
bounded, and thus it has a cluster point v. Without loss of generality we suppose that Vk ^ v 
as /u — >■ oo and get therefore that 

(3.26) Xfe X, Zk := h{xk) z, and yk := Vh{xk)*Vk Vh{x)*v = y 

with (z, v) G G. By the observation above (3.23), the triple (x, z, v) is the unique optimal solution 
to the unperturbed problem (3.22). On the other hand, applying the first-order necessary 
optimality conditions from [45, Theorem 6.12] to the solution (xfc, Zk, ffc) of the penalized problem 

(3.24) with a smooth cost function and a geometric constraint gives us 



v. 



i}(x,Vh{zyvk) + ^\\h{x) - Zk\ 



_ =0> 



-V 



^(xk,Vh{xkyv) + ^\\h{xk) - zf] eN{{zk,Vky,G) 

\ J Z£k -I (z.v)=[zi,.vi.) 



for all k G IN. Denoting pk := [h{xk) — Zk]/£k, these conditions calculate out to 

(3.27) V:,t?(xfc,yfc) + V2(t;fe,/i)(xfc)Vyt?(xfc,yfc) + V(pfc,/i)(xfc) =0, 

(3.28) [pk, -Vh{xk)Vyi»ixk, yk)) e N{{zk,Vky,G). 

By passing above to subsequences as A; — )■ oo if needed, we can reduce the situation to considering 
one of the following two cases: 

Case 1: {pk} converges to some p. 

Case 2: pfe — >■ oo while {pa;/||pa;||} converges to some p ^ 0. 
In Case 1 it follows from (3.26), (3.27), and (3.28) that 

(3.29) V,??(x, y) + V\v, h){x)Vy^{x, y) + V{p, h)ix) = 0, 

(3.30) (p, -Vh{x)Vy^{x, y)) G iV((z, i;); G), 
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where VxT^ix,y) = —lo and Vy'd{x,y) = ^ by the second equality in (3.21). 

In Case 2 we get, dividing first both parts of (3.27) and (3.28) by \\pk\\ and then passing to 
the hmit therein as A; — >■ cxd, that 

(3.31) V/i(x)*p = and (p, 0) G iV((z, t;); G) with ||p|| = 1. 

Thus, by talking into account our choice of (w, € N{{x, y); 0,) and the construction of M in 
(3.25), we deduce from (3.29)-(3.31) the existence oi v & M(x,y) and p satisfying either (3.29) 
and (3.30) or (3.31). Since the arguments above equally hold for every point (x, y) G gphdip 
near {x,y), they ensure the following description of the regular normal cone to $7 = gphi^ at 
points {x,y) G f2 in a neighborhood of the reference one {x,y), where G = gphd9: 



(3.32) 



(w, -C) G N{{x, y);n)^ 3 v G M(x, y), peW" such that 

( uj = V^{v,h){x)^ + Vh{x)*p 

\ with {p,-Vh{x)C) eN{{h{x),v);G) 

or: Vh{x)*p = with {p,0) e N{h{x),v)-G), ||p|| = 1. 



Next we take any basic normal (w,— ^) G N{x,y);Q,) (not just a regular one) and by (2.5) 
find sequences {xk,yk) {x,y) and {ojk, — Cfc) ~^ {^-i ~0 as A; — cxd satisfying 

{xk,yk)&^ and (w/c-^fe) G iV((a;fc,yfc);Q) for all k £ M. 

Employing the description of regular normals (3.32) ensures the existence of G M{xk,yk) 
and pk G such that the either/or alternative in (3.32) holds for each k G JN . Due to the 
established local boundedness of the mapping M, suppose with no loss of generality that 

Vk ^ V as A; — >■ oo for some v e M{x,y). 

By a further passage to subsequences, we can reduce the situation to where just one of the 
"cithcr/or" parts of the alternative in (3.32) holds for all k. Consider first the "or" part of this 
alternative, i.e., the validity of 

Vh{xk)*Pk = with {pk,0) G N{h{xk),Vky,G), \\pk\\ = 1 for all k. 

In this case the sequence {pk} has a cluster point p, and thus we get 

(3.33) V/i(x)*p = with {p,0) e N{{h{x),v);G), = 1, and veM{x,y) 

by passing to the limit as A; — >■ oo and taking into account (2.5) and the continuity of / and V/i. 

When the "either" part holds, we proceed similarly to Cases 1 and 2 above. In the first case 
there is p G M™ such that pk — > p- Then the passage to the limit in 

(3.34) LOk = V^{vk, h){xk)^k + Vh{xk)*Pk, (pk, -^h{xk)^k) e iV((/i(xjt), ■Ufe); G) 
with taking into account the continuity assumptions and the convergence above, leads to 

(3.35) uj = V^{v, h){x)^ + Vh{x)*p, {p, -Vh{x)0 G N{{h{x), v); G). 

In the remaining case we have \\pk\\ —> co and thus find p such that p with ||p|| = 1. 

Divide now both sides of (3.34) by \\pk\\ for any large k and take the limit therein as A; — >■ oo. 
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Then we again arrive at (3.33). Unifying (3.33) and (3.35) gives as the description of basic 
normals to O = gph d(p via the following alternative: 



(a;,-0 GiV((x,y);0) 



3 € M(x, y), j9 G such that 



(3.36) 



either: 



oj = V2(i;, h){x)^ + Vh{x)*p 

with {p,-Vh{^)i) &N{{h{x),v);G) 



or: V/i(x)*p = with (p, 0) G Ar(/i(x), ?;); G), ||p|| = 1. 



Remembering the notation introduced in the theorem and the definitions of the constructions 
used, we see that the "either" part of (3.36) amounts to the second-order subdifferential inclusion 
(3.18) while the "or" part of (3.36) means the negation of the basic second-order qualification 
condition (3.19). Thus the assumed fulfillment of (3.19) shows that the "or" part of (3.36) does 
not hold, which justifies the validity of the second-order chain rule (3.18). 

Repeating finally the arguments above with taking in to account that the partial counterparts 
of the first-order chain rule equality (3.20) are satisfied due to the results of [19, Proposition 3.4] 
(see also [45, Corollary 10.11] and [29, Corollary 3.44] in more general settings), we get the 
partial second-order subdifferential chain rules (3.16) and (3.17) under the partial second-order 
qualification condition (3.15). A 

Remark 3.4 (second-order chain rules with inclusions). A chain rule in form (3.16) 
for the full second-order subgradient sets of strongly amenable compositions with compatible 

parametrization in finite dimensions was derived in [18] under the second-order subdifferential 
condition of type (3.15) with Vh{x,w) replacing Vxh{x,w). The proof in [18] was based on 
applying a coderivative chain rule to full first-order subdifferential mappings. A similar approach 
was employed in [28] and [29, Theorem 3.74] to derive second-order chain rules of type (3.18) 
in infinite dimensions under an appropriate infinite-dimensional counterpart of the second-order 
qualification condition (3.19). Although the results of [28, 29] arc applied to a more general class 
of subdifferential regular functions 6 in (3.18), they require a number of additional assumptions 
in both finite and infinite dimensions. Finally, we mention a second-order chain rule of the 
inclusion type (3.18) obtained in [32, Theorem 3.1] for s special kind of strongly amenable 
compositions with the indicator function = 5{-;&) of a set in finite dimensions, which 
does not generally require the fulfillment of the second-order qualification condition (3.19) while 
imposing instead of a certain calmness assumption on some auxiliary multifunction. The latter 
holds, in particular, in the case of polyhedral sets G due to seminal results of [42]. 

Next we show that the second-order chain rule formula (3.18), and hence those in (3.16) 
and (3.17), cannot be generally used for precise calculating the second-order subdifferentials 
of strongly amenable compositions: the inclusion therein may be strict even for fairly simple 
functions 9 and h vn (p = 9 oh without a kind of full rank condition. 

Example 3.5 (strict inclusion in the second-order chain rule formula). The inclusion 
in (3.18) can he strict even when h is linear while 9 is piecewise linear and convex. Moreover, 
the set on right-hand side of (3.18) can he nonempty when the one on the left-hand side is empty. 



Proof. Let the functions h: M"^ and 6': M"^ — > M be given by 



h{xi,X2) := {xi,—xi,X2,—X2) = Ax with A:= 



1 
-1 
1 
-1 
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Z2, ^3, 2:4) := max 2:2, ^3, ^4} = cfm{z), 



where M := {v = {vi,V2, t's, ^4) G Vi > 0, Vi = 1} is the unit simplex in M^, and where 

aa stands for the support function of the set O. Considering the composition (p{x) := 0{h{x)) 
on R^, observe that it can be represented as 

(3.37) ^(x) = UBix) for B := {(2/1,2/2) e M^j + |y2| < l}. 

Note that the outer function 6 in the strongly amenable (in fact fully amenable) composition 

9 o h is convex piecewise linear in terminology of [45]; it can be equivalently described by [45, 
Theorem 2.49] as a function with the polyhedral epigraph. 

Using the explicit form (3.37) of if allows us to compute its second-order subdifferential 
d'^ip{x,y) with x = (0,0) and y = (0,0) directly by Definition 2.1. Indeed, we get from (3.37) 
that d(p{x) = B, and hence y G int dip{x). This tells us that 

/O QON fl2 /- -N. N / M2 if «= (0,0), 

(3.38) d ip{x,y)iu) ^ ■> 



I if (0,0). 

On the other hand, formula (3.18) reads as the inclusion d'^(p{x,y){u) C Q{u) with 



Q{u) ■.= \j{A*dH{0,v){Au] 



V eM, A*v = 0\ 



Take u = (0, 1), v = (1/2, 1/2, 0, 0) and then check that Au = (0, 0, 1, -1), v e M, and A*v = 0. 
This ensures the converse inclusion 

Q{u) D A*d'^e{0,v){Au), 

which shows that we have Q{u) 7^ provided that d^6{0, v){Au) ^ 0. To check the latter, recall 
the representation of the outer function 6 = um = <^m indicator function 5m = 5{-;M) 

of M. Thus we get the description 

uj e d'^9{0,v){Au) <^ -Au G d'^SM{v,0){-uj). 

Since the set M is a convex polyhedron, an exact formula for d'^SM{0,v) is available from [9]. 

In order to state this formula, wc need to deal with the critical cone for a convex polyhedron 
^l at x e Q with respect to p G d6a{x) = Nq{x); this is a polyhedral cone defined by 

K{x,p) := {w eTn{x)\w ± p}, 

where Tq{x) is the tangent cone (2.7) to at x. Recall that a closed face C of a polyhedral 
cone if is a polyhedral cone of the form 

C := {x e K\ X -L v} for some v G K*, 

where K* denotes the polar of the cone K. By the proof of [9, Theorem 2] (see also [38, 
Proposition 4.4]) we have the following description of the second-order subdifferential of the 
indicator function for a convex polyhedron: 



(3.39) w G d^5nix,p){u) 



there exist closed faces Ci C C2 of K{x,p) 
with u e Ci - C2, w e (C2 - Ci)*. 



Applying this to our setting with the simplex U = M, we get the critical cone 

K = TM{v)nO^ =Tm{v) = \{uJi,L02,tOs,L04) ^ \ n ]■ 

^ ^3 ^ U, UJ4 ^ U J 
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It follows from the second-order subdifferential formula (3.39) that 

4_ o2r /- \ f there exist closed faces Ci C C2 of K 

-An e d 6m{v,0){-^) ^ [ ^^c,- C, -An G (C, - C,)*. 

Observe that the closed faces of K have the form 

{(a;i,a;2)| wi +a;2 = 0} X / X J, where /, J can be either M+ or {0}. 

Denoting by L the subspace in {. . .} of the formula above, we have the following possibilities: 

Ci - C2 = L X (Ji - h) X (Ji - J2) and (Ci - C2)* = x (7i - ^2)* x (Ji - J2)*, 

where Ii — I2 and Ji — J2 can be R, M+, and {0} while, respectively, (Ii — 12)* and (Ji — J2)* 
can be {0}, M_, and M. Setting now {h - h)* = R- and (Ji - J2)* = M, we get 

~Au e d'^6Miv,0){-uj), or equilvalently uj e d'^9{0,v){Au) 

whenever uj €^ L x x {0}. Taking, e.g., u = (0, 0, 1, 0) gives us d^e{0,v){Au) / 0. Hence the 
set Q{u) on the right-hand side of (3.18) is nonempty while d'^(p(x,y){u) = by (3.38). A 

It is not hard to check that the second-order qualification condition (3.19) does not hold 
in Example 3.5. Thus, besides the emphasis above, this example can be considered as a coun- 
terexample to equality in the second-order chain rule (3.18) with no full rank condition on the 
derivative and also as an illustration of the possible validity of the inclusion in (3.18) without 
the second-order qualification condition (3.19). In the next section we show that the fulfillment 
of (3.19) yields, for a large class of outer functions 9 in amenable compositions 9 o h including 
the one in Example 3.5, that the full rank condition must be satisfied, and so the second-order 
chain rule formula (3.18) holds in fact as equality. 



4 Analysis of the Basic Second-Order Qualification Condition 
and Calculating Second-Order Subdifferentials 

This section is mainly devoted to analyzing the basic second-order qualification condition (3.19); 
our analysis equally works for the partial second-order counterpart (3.15). 
It is clear that (3.19) holds under the full rank condition 

(4.1) rank Vh{x) = m <S=^ ker Vh{x)* = {0}, 

which ensures the equality in (3.18) with a unique vector v in (3.18) and (3.19) by Theorem 3.1. 
Another setting where condition (3.19) automatically holds is when is of class C^'^ around 
z = h{x), which however excludes the case of extended-real- valued outer functions typical in 
applications of amenable compositions in variational analysis and optimization. 

We show in what follows that, for large classes of amenable compositions, the second-order 
qualification condition (3.19) yields in fact the validity of the full rank condition (4.1) and hence 
the exact second-order subdifferential chain rule formula 

(4.2) d'^ip{x, y){u) = {y'^{v, h){x)u + Vh{x)* d'^9{z, v){Vh{x)u)^ for all u 

with a unique vector v G d9{z) satisfying \7h{x)*v = y. As a by-product of our approach, we 
efficiently calculate the second-order subdifferential of functions belonging to such classes. 
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Recall [37, 45] that a strongly amenable function (p is fully amenable at x if the outer function 
9: — >■ M in its composite representation (p = 9oh can be chosen as piecewise linear quadratic. 
The latter class includes piecewise linear functions discussed in Example 3.5 and have their 
domains as well as their subgradient sets (2.2) and (2.3) to be polyhedral; see [45, SectionlOE]. 

We start with a local reduction lemma that describes a general setting where the second- 
order chain rule (3.18) holds as equality. Then we show that it is the case for some major classes 
of fully amenable functions under the second-order qualification condition (3.19). 

Lemma 4.1 (local reduction to full rank condition). Let (/):M" — > M 6e a strongly 
amenable composition at x represented as (f = 9 o h near x with h: — >■ and 9: R. 
Denote by S{z) the subspace parallel to the affine hull aSd9{z) C W^, and let L be any subspace 
ofW^ satisfying the inclusion 

(4.3) L D S{z) for all z G sufficiently close to z = h{x). 

Then we have the exact second-order chain rule formula (4.2). 

Proof. Let dimL = s < m. It is easy to see that s = m corresponds to the full rank condition 
on Vh{z), and thus the second-order chain rule (4.2) follows from Theorem 3.1. Suppose now 
that s < m, and let A be the matrix of a linear isometry from into W x M"*"* under which 
AL = X {0}. Denoting P := Ah and t9 := 9A~^ gives us the representation if = {} o P. 
Hence the initial framework of the lemma can be reduced to one in which we have, in terms of 
P{x) = (pi(x), . . . -iPmix)) and z = Ax, the implication 



This means that in analyzing d^p locally via d and P it is possible to pass with no loss of 
generality to the "submapping" 

Pq:x^ {pi{x),... ,Ps{x)), 
since only pi, . . . ,ps are active locally while Ps+i, ■ ■ ■ ,Pm do not matter in the implication 

y e d(p{x) 3v e d'd{P{x)) such that VP{x)*v = y. 

It suffices therefore to impose a full rank (= s) condition on Pq ^-nd invoke the second-order chain 
rule in equality form (4.2) from Theorem 3.1. The result of the lemma can be then translated 
back to the original context of = 9 o h through A~^. A 

Observe that the full rank condition on Pq comes out in the context of Lemma 4.1 from 



We show in what follows that a subspace L in (4.3) is provided by the second-order qualification 
condition (3.19) when ip = 9 o h belongs to major classes of fully amenable compositions. 

To proceed in this direction, let us first calculate the second-order subdifferential d^9{z, v){0) 
from the left-hand side of (3.19) for general convex piecewise linear-quadratic functions 9, which 
is certainly of its own interest. 

Theorem 4.2 (calculating the second-order subdifferential of convex linear-quadratic 
functions). Let ip = 9 oh be a fully amenable composition at x, let M:W^ x =^ R"* be a 
set-valued mapping defined in (3.25), and let S{z) be a subspace ofW^ parallel to the affine hull 



z sufficiently close to z 

V = {Vi, ... ,Vm) e d"d{z) 




VgJrl = 0, . . . , = 



0. 



LnkerV/i(x)* = {0}. 
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aSd6(z) for z near z = h{x). Then for any sufficiently small neighborhood O of z there is a 
finite union of the subspaces S{z) such that 

(4.4) d^9{z,v){0) = [J S{z) whenever V e M{x,y). 

z€0 

Proof. As mentioned in the proof of Theorem 3.3, the mapping M from (3.25) is closed-graph 
around {x,y,z) and uniformly bounded around {x, y) for strongly amenable compositions. Since 
6 oh is fully amenable, the set M(x,y) is also polyhedral for all {x,y) sufficiently close to {x,y). 

Fix any v € M{x,y). Since 6 is piecewisc linear-quadratic, its graph G := gph^? is piecewise 
polyhedral, i.e., it is the union of finitely many polyhedral sets in M"'. Using this and taking 
formulas (2.5) and (2.6) into account, we find a neighborhood W of {z, v) such that 

(4.5) NG{z,v) = [j{NG{z,v)\ {z,v) e a nw} = \j[TG{z,vy \ {z,v)eGnw}, 

where only finitely many cones (all of them are polyhedral) occur in the unions. Therefore 

(4.6) w ed'^9{z,v){0) ^3{z,v) eCnW with {w,0) e Tg{z,v)* . 

On the other hand, we have Tg{z,v) = gph{Dd9){z,v) by definition of the graphical derivative 
D oi a set-valued mapping, and furthermore 



{Dde){z,v) = d(^^d^e{z,v)^ 



via the second subderivative of the function under consideration; see [45, Theorem 13.40 and 
Proposition 13.32] for moire details. Hence it ensures that 

dom{Ddd){z,v) = dom.d'^9{z,v) = Ngg(^z^{v) 

by [45, Theorem 13.14]. Employing now (4.5) and (4.6) gives us the representations 

d^9{z,v)i0) = U [dom{Dd9)iz,v)y = [j [iVae(«)(«)] * 

^4 (z,v)eGnw {z,v)eGnw 

{z,v)€GnW 

where only finitely many sets are taken in the unions. Pick v € 89 (z) and find, by the poly- 
hedrality of the subgradient sets 89 {z) and the construction of the subspaces S{z), a vector 
v' G Ti8<p{z) arbitrary close to v' and get for all such v' the relationships 

T3e{z)iv') = S{z)DT90^,){v), 

which imply by (4.7) the equality 

8''9{z,vm = [jS{z), 

where the finite union of subspaces are taken over z such that {z,v) e GHW for some v. 

So far we focused our analysis on a particular point v G M{x, y) and an associated neigh- 
borhood W of {z,v). Since the mapping M is of closed graph and locally bounded, the set 
M(x, y) can be covered by finitely many of such neighborhoods. This allows us to obtain (4.4) 
and complete the proof of the theorem. A 

Note that representation (4.4) held for outer functions of any fully amenable composition is 
not generally sufficient for applying Lemma 4.1 and deducing thus the second-order chain rule as 



18 



equality (4.2) from the second-order qualification condition (3.19). To proceed in this direction, 
we need to get just one subspace in representation (4.4), which serves all v G M{x,y) therein. 
The next result shows that it can be done in the case of piecewise linear outer functions in fully 
amenable compositions (p = 9 oh. 

Theorem 4.3 (second-order chain rule for fully amenable compositions with piece- 
wise linear outer functions). Let ip = 6 o h he a fully amenable composition at x, where 
6:W"- — )■ M is {convex) piecewise linear. Assume that the second-order qualification condition 
(3.19) is satisfied. Then we have the exact second-order chain rule formula (4.2). 

Proof. It is not hard to check that for convex piecewise linear functions p we have the inclusion 
d9{z) C d9{z) for any neighborhood O oi z sufficiently small. This implies that S{z) C S{z) 
whenever z and hence ensures the equality 

(4.8) d'^9{z,v){jd) = S{z) 

by formula (4.4) from Theorem 4.2. Employing the latter subdifferential representation in the 
second-order qualification condition (3.19) gives us 

(4.9) S{z) n ker Vh{x)* = {0} for all zeO. 

Recall that the subspace S{z) consists of all vectors \{v' — v) such that A G M and A, A' G d9{z). 
Hence the second-order qualification condition (4.9) is equivalent to the following: there exist 
neighborhoods U oi z and V oi y such that 



x eU, y eV, v,v' e M{x,y) 



V = v' . 



On other words, the latter means that the mapping M from (3.25) is single-valued on the 
subdifferential graph gph(?(/? around (x,y) in the case under consideration; thus it is continuous 
as well. The result of the theorem follows now from Lemma 4.1. A 

Next we consider a major subclass of piecewise linear-quadratic outer functions in fully 
amenable compositions given by 

(4.10) 9{z):=sup{{v,z)-\{v,Qv)], 

vec J 

where C C M"* is a nonempty polyhedral set, and where Q G M."^^'^ is a symmetric positive- 
semidefinite matrix. Functions of this class are useful in many aspects if variational analysis 
and optimization; in particular, as penalty expressions in composite formats of optimization; see, 
e.g., [45] and the references therein. By definition (4.10) we see that 9 in (4.10) is proper, convex, 
and piecewise linear-quadratic (piecewise linear when Q = 0) with the conjugate representation 

(4.11) 9{z) = (dc + jQTiz) for jQ{v) := ^{v,Qv). 

In the following theorem we calculate the second-order subdifferential of functions 9 from (4.10) 
and justifies the equality second-order chain rule formula (4.2) for fully amenable compositions 
ip = 9 oh with outer functions of this type. 

Theorem 4.4 (second-order calculus rule for a major subclass of fully amenable 
compositions). Let (p = 9 o h be a fully amenable composition at x with 9:W^ M. of class 
(4.10) satisfying the assumptions made above. Suppose also that the second-order qualification 
condition (3.19) is satisfied. Then we have the exact second-order chain rule formula (4.2). 
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Proof. It follows from (4.11) that the conjugate to 6 is 9* = 5c + Jq- Observe also that 

(4.12) w e d'^e{z, v){u) ^-ue d'^e*{v, z){-w). 
Furthermore, we have by the calculations in [45, Example 11.18] that 

(4.13) de*{v) = Nc{v) + Qv, V e C, 

and hence z S 89* (v) -4=^ z — Qv G Nc{v). Using this and definition (2.11) of the second-order 
subdifferential and then applying the coderivative sum rule [29, Theorem 1.62] to (4.13) give us 

d'^e*{v, u){-w) + D*Nciv, z - Qv){-w) + Vjqi-w). 

Since VjQ{—w) = Qw, the latter implies in turn that 

(4.14) -ue d^9*{v,z){-w) ^ Qw - u e d^5c{v,z - Qv){~w). 

Employing (4.12, (4.14) and proceeding similarly to the consideration in Example 3.5 above, we 
get from (4.14) the exact formula for calculating the second-order subdifferential: 



(4.15) ued'^9{z,v){w) 



3 closed faces Ki D K2 of K 

with w ^ Ki - K2, Qw - ue {Ki - K2) 



where K is the critical cone for C at v with respect to z — Qv given by 

K = Tc{v) n (z - Qv)^. 

The positive-semidefiniteness of the matrix Q yields that 

> {w, Qw) <(=^ Qw = <(=^ z G ker Q, 

which allows us to deduce from (4.15) that 

w e d'^9{z, v){0) ^ 3KiD K2 with w e Ki - K2, Qw G {Ki - K2)* 

3KiD K2 with w G (ker Q) n [Ki - K2) 
^ we {]<ie^:Q)f^{K -K). 

Thus the set d'^9{z^v){Qi) is a subspace in W^. Substituting it finally into the second-order 
subdifferential condition (3.19) and taking into account that d9{z) = {Nc + Q)~^{z) by [45, 
Example 11.18], we arrive at the second-order equality chain rule (4.2) similarly to the proof of 
Theorem 4.3 based on the application of Lemma 4.1. A 



5 Applications to Tilt Stability in Nonlinear and Extended Non- 
linear Programming 

The second-order chain rules and subdifferential calculations obtained in Sections 3 and 4 are 
undoubtedly useful in any settings where the second-order subdifferential (2.11) and its partial 
counterparts are involved; see the discussions and references in Section 1. In this section we 
confine ourselves to the usage of second-order chain rules for deriving full characterizations of 
tilt-stable local minimizers in some important classes of constrained optimization problems. It 
requires applying equality-type formulas of the second-order subdifferential calculus. 

The notion of title-stable minimizers was introduced by Poliquin and Rockafellar [39] in 
order to characterize strong manifestations of optimality that support computational work via 
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the study of how local optimal solutions react to shifts (tilt perturbations) of the data. Recall 
that a point x is a tilt-stable local minimizer of the function if: M" — )■ M finite at x if there is 
7 > such that mapping 

M: y I-)- argmin|(/?(x) — ip{x) — {y,x — x) \\x — x\\ < 7| 

is single-valued and Lipschitz continuous on some neighborhood of y = with M(0) = x. 

It is proved in [39, Theorem 1.3] that for — >• M having G dip{x) and such that (p is 
both prox-regular and subdiffcrcntially continuous at x for y = 0, the point x is a tilt-stable 
local minimizer of if and only if the second-order subdifferential mapping 0): M" =^ 

is positive-definite in the sense that 

(5.1) {'w,u) > whenever w G d'^ip{x,0){u) with u^O. 

The aforementioned properties of prox-rcgularity and subdifferential continuity introduced in [38] 
(see also [45, Definitions 13.27 and 13.28]) hold for broad classes of "nice" functions encountered 
in variational analysis and optimization. In particular, both properties are satisfied, at all points 
of a neighborhood of x for any function strongly amenable at x; see [45, Proposition 13.32]. 

Our subsequent goal is to extend the characterization of tilt-stable local minimizers from 
[39] to favorable classes of constrained optimization problems. To proceed, wc tisc the following 
composite format of optimization known as extended nonlinear programming (ENLP) ; see [44, 45] : 

(5.2) minimize ip{x) := ipo{x) + 6{ipi{x), . . . ,{pm{x)) = ipo{x) + {6 o ^)(x) over x G M", 

where 9: M™ ^ M is an extended-real-valued function, and where $(x) := {ipi{x), . . . ip„i(x)) is 
a mapping from M" to M™. Written in the unconstrained format, problem (5.2) is actually a 
problem of constrained optimization with the set of feasible solutions given by 

X :={xe M"| {ipi{x), ipraix)) G Z} for Z := {z e R"*! e{z) < oo}. 

In other words, problem (5.2) can be equivalently represented in the form 

(5.3) minimize ipo{x) + 5z{^{x)) over x G R™ with Z = domO 

via the indicator function of the feasible set. As argued in [44], the composite format (5.2), or 

(5.3) , is a convenient general framework from both theoretical and computational viewpoints 
to accommodate a variety of particular models in constrained optimization. Note that the 
conventional problem of nonlinear programming with s inequality constraints and m — s equality 
constraints can be written in form (5.3), where Z = Rl x {0}™^*. 

Our first result provides a complete second-order characterization of tilt-stable minimizers x 
for a general class of problems (5.2) under full rank of the Jacobian matrix V$(x). 

Theorem 5.1 (characterization of tilt-stable minimizers for constrained problems 
with full rank condition). Let x E X be a feasible solution to (5.2) such that ipo and $ 

are smooth around x with their derivatives strictly differentiable at x, that rankV^>(x) = m, 
and that 9 is prox-regular and subdifferentially continuous at z := $(x) for the (unique) vector 
V G R"^ satisfying the relationships 

(5.4) V G d9{z) and S/^{x)*v = -Vipo{x). 

Then x with —S/ipo{x) G V^{x)*d9{z) is a tilt-stable local minimizer of (5.2) if and only if the 

mapping T: R"- ^ R" given by 

(5.5) T{u) := V^{v, ^){x){u) + V^{xyd^e{z, v){V^{x)u), u G R", 
is positive- definite in the sense of (5.1). 
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Proof. Since i^o and $ are smooth around x and V$(a;) has full rank m, it follows from the 
first-order subdifferential sum and chain rules of [45, Corollary 10.9 and Exercise 10.7] that 

€ d<f{x) -Vifoix) G V<^{x)*de{z) 

for (p in (5.2). Furthermore, these rules and the definitions of prox-regularity and subdifferential 
continuity in [45] imply that the latter properties oi f at x for € dip{x) are equivalent to the 
corresponding properties of ^ at z for v satisfying (5.4). 

It remains to check therefore that the positive-definiteness (5.1) of d'^ip{x, 0) is equivalent to 
that of T in (5.5). We show in fact that d^Lp{x,0){u) = T{u) for aU u G W. Indeed, using the 
second-order chain rule from [29, Proposition 1.121] in (5.2) gives us 

(5.6) ^'^ip{x,Q){u) = V^'fo{x)u + ^'^{eo<^){x,-V^po{x)){u), « G R". 

To complete the proof of the theorem, we finally apply the exact second-order chain rule from 
Theorem 3.1 to the composition 9 o ^ m. the latter equality. A 

Next we address the conventional model of nonlinear programming (NLP) with smooth data: 



(5.7) minimize fo{x) subject to ipi{x) = 



< for ?; = 1, . . . , s, 

= for i = s + 1, . . . , m. 



As mentioned above, problem (5.7) can be written in form (5.3) with Z = Ml x {0}"* For 
this problem, the full rank condition of Theorem 5.1 corresponds to: the gradients 

(5.8) Vipi{x), . . . , Vifmix) are linearly independent. 

Actually, since our analysis is local, we can drop in what follows any inactive inequality con- 
straints from the picture and thus reduce with no loss of generality to having 

(5.9) ipi{x) = for all i = l,...,m. 

The full rank condition (5.8) in case (5.9) is then the classical (LICQ): the active constraint 
gradients at x are linearly independent. 

To proceed further, consider the Lagrangian function in (5.7) given by 

m 

L{x, A) := ifoix) + Xm{x) with A = (Ai, . . . , A^) G M™ 

i=l 

and remember that, for any local optimal solution x to (5.7), the LICQ at x ensures the existence 
of a unique multiplier vector A = (Ai, . . . , Xm) £ R+ x M."^'^ such that 

m 

(5.10) V^L{x, A) = V^o(S) + Yl ^iV^i(x) = 0. 

i=l 

Recall that the strong second-order optimality condition (SSOC) holds at x if 

(5.11) {u, Vl^L{x, X)u) > for ah 7^ u G S, 
where the subspace S C is given by 

S := {u e M"| {V(pi{x), u) = whenever i = l,..., m}. 

Note that (5.11) is also known as the "strong second-order sufficient condition" for local op- 
timality. The following theorem shows that, in the setting under consideration, the SSOC is 
necessary and sufficient for the tilt stability of local minimizers. 
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Theorem 5.2 (characterization of tilt-stable local minimizers for NLP). Let x he a 

feasible solution to (5.7) such that all the functions ipi for i = 0, . . . ,m are smooth around x with 
their derivatives strictly differentiable at x and that the LICQ is satisfied at this point. Then we 
have the following assertions: 

(i) If X is a tilt-stable local minimizer of (5.7), then SSOC (5.11) holds at x with the unique 
multiplier vector A G x M"^~* satisfying (5.10). 

(ii) Conversely, the validity of SSOC at x with A G x M"^~'^ satisfying (5.10) implies that 
X is a tilt-stable local minimizer of (5.7). 

Proof. As mentioned above, the LICQ corresponds to the full rank condition of Theorem 5.1 
in the setting under consideration. The prox-rcgularity and subdifferential continuity of the 
indicator function 9 = 6z with Z = W_ x {0}™'^'' follow from its convexity [45, Example 13.30]. 
Let us next represent the mapping T in (5.5) via the initial data of problem (5.7). It is easy to 
see that T{u) reduces in this case to 

T{u) = Vl^L{x, X)u + V$(x)*925z(0, A)(V$(x)u), 

with $ = {ifi, . . . ,(pm) and Z = W_ x {0}™~*, provided that the first-order condition (5.10) is 
satisfied, which is of course the case when x is a local minimizer of (5.7). Thus the positive- 
definiteness of T{u) amounts to 

(5.12) u^O, we 5^(5^(0, X){u) =^ {u, S/l^L{x, X)u) + {w, V^{x)u) > 0. 

To proceed, we calculate the second-order subdifferential 5^(5^(0, A) in (5.12) by using formula 
(3.39) presented and discussed in Example 3.5. Observe that the critical cone in this situation 
is K = Z nX^. It follows directly from (3.39) that 



w e d^6z{0,X){u) <= 
The latter implies in turn that 



there exist closed faces Ki C K2 of K 
with - V^{x)u e Ki - K2, w e {K2 - Ki) 



min_ {w,V^(x)u)=0 for all u e dom.d^6z(0, X) 



with the subdifferential domain representation 



dom 52^2(0, A) = U {(Ki - K2) 



Ki C K2 closed faces of K\ = K — K. 



Substituting this into (5.12) and taking into account the forms of the critical cone K as well as 
the subspacc S in (5.11), we conclude that the positive-definiteness condition (5.12) is equivalent 
to the strong second-order optimality condition (5.11) provided that (5.10) holds at x. 

Having this in hand and using Theorem 5.1 allow us to justify both assertions in (i) and 
(ii). Indeed, since every tilt-stable local minimizers x is a standard local minimizer, it satisfies 
the first-order necessary optimality condition (5.10) under the assumed LICQ at x. Thus the 
SSOC holds at this point, which is the assertion in (i). The validity of the converse assertion 
(ii) follows from the equivalence between (5.12) and (5.11) under (5.10) proved above. A 

The obtained characterization of tilt-stable minimizers for NLP leads us to comparing this 
notion with the classical Robinson's notion of strong regularity [41] of parameterized variational 
inequalities associated with the KKT conditions for NLP (5.7). Complete characterizations of 
strong regularity for NLP are derived in [9]; see also the references therein. 
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Corollary 5.3 (comparing tilt-stability and strong regularity). Under the assumptions 
of Theorem 5.2, the tilt- stability of local minimizers for (5.7) is equivalent to the strong regularity 
of the variational inequality associated with the KKT conditions for (5.7). 

Proof. It follows directly from Theorem 5.2 and the characterization of strong regularity ob- 
tained in [9, Theorem 5 and Theorem 6]. A 

It is not hard to check that the strong regularity of the KKT system directly implies the 
LICQ at the corresponding solution of (5.7). On the other hand, the LICQ requirement arising 
from the full rank condition of Theorem 5.1 is essential for the SSOC characterization of tilt- 
stability in Theorem 5.2. Furthermore, even imposing the seemingly less restrictive second-order 
qualification condition (3.19) needed for deriving the second-order chain rule unavoidably leads 
us the the LICQ requirement for NLP, since the latter class is represented via fully amenable 
compositions with piecewise linear outer functions 9 in the composite format (5.2). This follows 
from the results of Section 4 and is reflected in the next theorem. 

Theorem 5.4 (characterizing tilt-stable minimizers for constrained problems de- 
scribed by fully amenable compositions). Let x he a feasible solution to (5.2) such that ipQ 
smooth around x with the strictly differentiable derivative at x and that the composition 9 o<^ is 
fully amenable at x with the outer function 9: — >■ M o/ the following types: 

• either 9 is piecewise linear, 

• or 9 is of class (4.10) with a nonempty polyhedral set C C M™ and a symmetric positive- 
semidefinite matrix Q G x W". 

Assume further that the second-order qualification condition (3.19) holds at x, where v = —v 
is the unique vector satisfying (5.4) with z = <I>(,t). Then x with —V(po{x) G V^{x)*d9{z) is 
a tilt-stable local minimizer of (5.2) if and only if the mapping T: M" =^ M" defined in (5.5) is 
positive-definite in the sense of (5.1), where the second-order subdifferential d^9{z, v) is calculated 
by formulas (4.8) and (4.15), respectively. 

Proof. Observe first that in both cases under consideration the composition 0o$ is prox-regular 
and subdifferentially continuous at any point x around x by [45, Proposition 13.32]; hence the 
same holds for the function (p from (5.2). It follows from Theorems 4.3 and 4.4 that, under the 
validity of the second-order qualification condition (3.19), we have the unique vector v satisfying 
(5.4) and the second-order chain rule 

(5.13) d'^{9 o $)(x, -V^oix)){u) = (y^{v, ^){x)u + V^{xyd'^9{z, v){V^{x)u)^ 

for all u € M"" when 9 belongs to one of the classes considered in this theorem. Substituting 
further (5.13) into formula (5.6) due to the the second-order sum rule from [29, Proposition 1.121] 
allows us to justify that 

d'^ip{x,0) = T{u) whenever u G M", 

and thus the positive-definiteness of the mapping T from (5.5) fully characterizes the tilt-stability 
of the local minimizer x of (3.1) in both cases of 9 under consideration with the formulas for 
calculating of d'^9{z,v) derived in the proofs of Theorems 4.3 and 4.4, respectively. A 

We conclude the paper with the following two final remarks. 

Remark 5.5 (sufficient conditions for tilt-stable local minimizers). The second-order 
chain rule (3.18) of the inclusion type derived in Theorem 3.3 for strongly amenable compositions 
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and the second-order sum rule inclusions obtained in [29, Theorem 3.73] allow us to establish 
general sufficient conditions for tilt-stable local minimizers in large classes of constrained opti- 
mization problems written in the composite format (5.2). Indeed if, in addition to the hypotheses 
of Theorem 3.3 for the composition 9 o ^ m (5.2), we assume that the function (pQ is, e.g., of 
class C^'^ around x, then we have by the second-order sum rule from [29, Theorem 3.73(i)] and 
the chain rule of Theorem 3.3 the fulfillment of the inclusion 

(5.14) d^(p{x,0){u) cT{u), weM", 

for ip from (5.2) and T from (5.5). The prox-regularity and subdiffercntial continuity of such 
functions (p follow, under the assumptions made, from [45, Proposition 13.32 and Proposi- 
tion 13.34] and first-order subdifferential calculus rules. Thus inclusion (5.14) ensures that the 
positive-definiteness of T implies the one of d'^(p{x,0), and the former is therefore a sufficient 
condition for the tilt-stability of local minimizers of (5.2). 

Remark 5.6 (full stability of local minimizers). Developing the concept of tilt stability, 
Levy, Poliquin and Rockafellar [19] introduced the notion of fully stable local minimizers of 
general optimization problems of the type 

(5.15) minimize ip{x,u) — {v,x) over x G M" 

with respect to both "basic" perturbations u and "tilt" perturbations v. The main result of that 
paper [19, Theorem 2.3] establishes a complete characterization of fully stable local minimizers 
of (5.15) via the positive-definiteness of the extended partial second-order subdifferential (2.13) 
of if. Similarly to the results of this section for tilt-stable minimizers of constraint optimization 
problems written in the composite format (5.2), we can derive characterizations as well as 
sufficient conditions for fully stable minimizers of (5.15) based on [19, Theorem 2.3] and the 
second-order chain rules for the partial second-order counterpart (2.13) obtained above. Our 
ongoing research project is to comprehensively elaborate these developments on full stability in 
constrained optimization and its applications. 

Remark 5.7 (tilt stability and partial smoothness). After completing this paper, we 
became aware of the concurrent work by Lewis and Zhang [21] related to second-order subdif- 
ferentials (generalized Hessians) and tilt stability. The main results of [21] provide calculations 
of the basic second-order construction from Definition 2.1 for C^-partly smooth functions on 
C^-smooth manifolds and then characterize tilt stability in such settings via strong criticality 
and local quadratic growth. 
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